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Abstract 

Experimental studies of synchronization properties on networks with controlled connection topology can 
provide powerful insights into the physics of complex networks. Here, we report experimental results on 
the influence of connection topology on synchronization in fiber-optic networks of chaotic optoelectronic 
oscillators. We find that the recently predicted non-monotonic, cusp-like synchronization landscape mani- 
fests itself in the rate of convergence to the synchronous state. We also observe that networks with the same 
number of nodes, same number of finks, and identical eigenvalues of the coupfing matrix can exhibit funda- 
mentally different approaches to synchronization. This previously unnoticed difference is determined by the 
degeneracy of associated eigenvectors in the presence of noise and mismatches encountered in real-world 
conditions. 



2 



Recent research D. Jl has shown that network structure plays a significant role in cascading fail- 
ures [2], epidemics yD, and recovery of lost network function [|4|]. Synchronization of coupled 
dynamical units is a widespread phenomenon that has served as an example par excellence of this 
line of theoretical research ||5|]. For example, by modeling network synchronization in terms of 
diffusively-coupled identical oscillators, it has been shown that the stability of fully synchronous 
states is entirely determined by the eigenvalue spectrum of the coupling matrix laLZD- A funda- 
mental yet largely unexplored question concerns the robustness of such network-based predictions. 

New insight into this question has been provided by a recent study on networks that optimize 
the synchronization range [8]. It is predicted that synchronization properties, such as the coupling 
cost at the synchronization threshold and range of coupling strength for stability, will exhibit a 
highly non-monotonic, cusp-like dependence on the number of nodes and links of the network ||8|], 
contrary to the prevailing paradigm. The existence of such cusps indicate that small perturbations 
of the network structure, which might be experimentally unavoidable, may lead to large changes 
in the network dynamics. 

In this work, we experimentally demonstrate that the rate of convergence to synchronous states, 
a broadly significant synchronization property, follows the theoretically predicted non-monotonic 
trend. More important, we observe that networks with identical eigenvalue spectra (generally 
assumed to behave in similar fashion) can exhibit qualitatively different convergence properties. 
We classify these networks into two groups, which we term nonsensitive networks and sensitive 
networks, respectively. This classification is based on the properties of the eigenvectors of the 
coupling matrix and the observation that networks with different eigenvector degeneracies will 
respond differently to perturbations typical of experimental conditions. In contrast to sensitive 
networks, nonsensitive networks are predicted and experimentally observed to be robust against 
these perturbations. We identify observational noise and mismatch of coupling strengths as the 
main experimental factors underlying these different responses. 

Our experimental setup consists of a network of iV = 4 optoelectronic feedback loops. The 
feedback loops are similar in construction to those used by Argyris et al. for chaotic communi- 
cation [9]. Each feedback loop (Fig.[T]) comprises a semiconductor laser which provides a steady 
optical power, a Mach-Zehnder electro-optic intensity modulator, two photoreceivers, a digital sig- 
nal processing (DSP) board which provides electronic filtering and time delay, and an amplifier. 
The optical output of each electro-optic modulator is proportional to cos^(xj + 00)^ where Xi is 
the normalized electrical input voltage that characterizes each oscillator, and 0o is the operating 



point of the modulator. The signals Xi(t) are recorded using a four-channel, 8-bit digital oscillo- 
scope. The modulator output is split to act as the feedback signal and as the coupling signal to the 
other nodes, with each coupling link either enabled or disabled using optical attenuators. In our 
experiments, all the couplings are set to have the same strength. At each node, the feedback and 
the coupling signals are processed using the DSP board. The parameters of each loop are set such 
that the oscillators exhibit high-dimensional chaos. The DSP board implements a 2-pole digital 
bandpass filter and a time delay on both the feedback and coupling signals. A diffusive-coupling 
scheme is implemented through the DSP board. The equations that describe each node in the 
experimental network are derived in Ref. Iioll . and are given by: 

dui{t) 
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Here, Ui(t) is a 2 x 1 vector describing state of the filter at node i, and Xi{t) is the observed 
variable. The oscillators are diffusively coupled through the network specified by the coupling 
matrix L = (iij); the diagonal element in > is the net incoming coupling strength to node i 
and the off-diagonal element iij is the negative of the directional interaction strength from node 
j to node /. Thus, if there is a link from j to i, the influence of oscillator j on oscillator i is 
proportional to [uj(t) — Ui{t)]. Matrices A, B, and C represent the filter in state-space. The filter 
band is from uJi/27r = O.lkHz to co2/2n = 2.5kHz. Regarding the other parameters, /3 = 3.6 is 
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FIG. 1. Schematic of a single optoelectronic node. Each node is coupled to the rest of the network (not 
shown) through fiber-optic links. The couplings are enabled/disabled using optical attenuators. 
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a lumped effective feedback strength that combines the gain factors of various components, e is a 
global coupling strength, d = Tr(L) /N is a normalization factor defined by the average coupling 
per node, 0o is a phase bias set to 7r/4, and r = 1.5ms is the net feedback delay. Equations dTK 
are a network generalization of the one- and two-oscillator systems considered in Refs. llO, H]. 
This network model admits synchronous solutions Xi{t) = X2{t) . . . = x^it), whose experimental 
realization is the focus of this study. 

Consider a network of N oscillators and m = Tr(L) directed links, of which our experimental 
system is an example. Since all the rows of matrix L sum to 0, L has at least one null eigenvalue. 
The eigenvalue spectrum A = {0, A2, A3, . . . , Aa?} of L determines whether the synchronous solu- 
tions for a given network configuration are stable Consider the eigenvalue spread [8], 

0^ = ^ ^y.\\-M\ where A = f^'=^ \ , (3) 

which measures the range of coupling strength e for stable synchronization and hence the synchro- 
nizability for general directed networks. Smaller eigenvalue spread implies higher synchronizabil- 
ity. Focusing on networks with the smallest eigenvalue spread for given number of nodes and links, 
Ref. [8] shows that the eigenvalue spread has cusp-like minima with cr = when m = k{N — 1) 
and 0- > for all networks with k{N - 1) < m < {k + 1){N - 1), where /c = 1, 2, . . . , A^. The 
networks minimizing a for a given number of nodes and links are termed optimal if a = and 
suboptimal if cr > (all the others are termed nonoptimal). In Fig. l2ta), we show a sequence of 
4-node optimal and suboptimal networks with decreasing number of links, which are considered in 
our experiment. The eigenvalue spread a of these networks exhibit pronounced non-monotonicity 
as a function of the number of links [Fig. Htb)]. 

In our experimental study, we first focus on the influence of network structure on synchroniza- 
tion properties. To this end we consider stable synchronous states, which correspond to configu- 
rations for which the synchronization error, defined as 

Oit)^ ^^^_^^ Y.\^.{t)-x,{t)l (4) 

ideally approaches zero. For real networks that synchronize, this error converges to a synchro- 
nization floor, 6^0, determined by experimental mismatches and noise. Figure [2tc) shows the ex- 
perimentally measured rate of convergence to synchronization for the sequence of optimal and 
suboptimal networks shown in Fig. Oa). This rate of convergence is defined as the exponent 11 
of the exponential decay to the synchronization floor, [9 — 9q) ~ exp{—nt), and can in principle 



be determined from the eigenvalues of the coupling matrix scaled as {^Aj} and the master stabil- 
ity function which is defined by the node dynamics, form of the coupling, and synchronous 
state. Before time t = 0, the nodes are uncoupled and evolve independently. At time t = 0, the 
couplings in the network are enabled by switching e from to 0.7, and the network converges 
to a synchronous solution. In order to avoid problems with zero crossings, we perform a boxcar 
moving-average over a small time interval on 9{t) to form {9{t)). We measure /i by fitting the 
smoothened synchronization error {9{t)) to an exponential over a fixed time interval from 0.5ms 
to 2.0ms. For each network, our statistics is based on performing this measurement for 100 inde- 
pendent realizations of the initial conditions. The results shown in Fig. [2tc) indicate only small 
variability across different realizations. More important, contrary to what has been usually as- 




m— 12 m - 1 1 m - 10 m — 9 m - 8 

A- {0,4,4,4} A- {0,3,4,4} A- {0,3,3,4} A- {0,3,3,3} A- {0,2,3,3} 

(optimal network) (optimal network) 



/h> .4^0 yf-, ,4^, /\ 

m — l m- 6 m — 5 m — 4 m-3 

A = {0,2,2,3) A = {0,2,2,2} A={0,1,2,2} A={0,1,1,2) A={0,1,1,1} 
(optimal network) (optimal network) 




1 I I I I I I I L 



3 4 5 6 7 8 9 10 11 12 
Number of links, m 



FIG. 2. Non-monotonic behavior of synchronization properties, (a) A path from a fully connected network 
(m = 12) to an optimal tree network (m = 3). At each step, the link removed is indicated by a dashed line, 
(b) The eigenvalue spread a for the networks in (a), (c) Experimentally measured mean convergence rate 
to synchronization, jl, and associated standard deviation (bars) for the same networks. The largest rate of 
convergence is observed when the number of network links is a multiple of — 1 = 3. 
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sumed, the measured mean convergence rate fi is found to change highly non-rnonotonically, with 
periodic peaks at the points where the number of links is a multiple of (A^ — 1) [8]. The eigenvalue 
spread a is seen to be inversely related to the convergence rate to synchronization, i.e., the larger 
the spread, the slower the approach to synchronization. Results for larger networks are included 
in supplementary information. Fig. SI. 

If experimental noises, delays and mismatches could be neglected, the synchronization proper- 
ties would be entirely determined by the eigenvalues of the coupling matrix |^ 7]. In particular, 
each network in the sequence of Fig.[2ta) is characterized by eigenvalues that minimize the spread 
cr. The sequence of optimal and suboptimal networks considered in our experiments of Fig.[2l;c) 
was generated by starting from a fully connected network and successively removing links while 
keeping the coupling matrix diagonalizable, so that the stability of the synchronous states could 
be analyzed within the standard master stability approach [6]. However, the coupling matrices of 
directed networks are not necessarily diagonalizable. There are in fact many more optimal and 
suboptimal networks with the exact same eigenvalues of those considered in Fig. [2a), but that are 
not diagonalizable because they have a number of independent eigenvectors smaller than 
For instance, out of four 4-node optimal networks with three links [Fig. [3ta)], one is diagonaliz- 
able and three are nondiagonalizable. (For the set of all optimal and suboptimal binary 4-node 
networks, see supplementary information. Table SI.) Given that a depends only on the eigenval- 
ues, one might expect that experimental realizations of nondiagonalizable networks would exhibit 
properties similar to those observed for the diagonalizable counterparts. 

In Fig.[3];b), we experimentally compare the approach to synchrony of two networks, a directed 
star and a directed linear chain, which have the maximum and minimum number of indepen- 
dent eigenvectors, respectively. These two networks are optimal and have the same number of 
nodes and links and identical eigenvalues. We performed 100 independent measurements of {9{t)) 
starting with different initial conditions for both networks. However, both the convergence to syn- 
chronization and the oscillations after synchronization are systematically different for these two 
networks. We refer to networks with nondiagonalizable coupling matrices as sensitive networks, 
since the experiments show that they are more susceptible to the influence of imperfections typical 
of realistic conditions. On the other hand, networks with diagonalizable coupling matrices are 
found to be fairly robust under the same conditions, and are referred to as nonsensitive networks. 
Mathematically, these two different types of networks can be categorized according to their geo- 
metric degeneracy, Qd, which is the largest number of repeated eigenvalues of the coupling matrix 
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FIG. 3. Differentiating behavior between sensitive and nonsensitive networks, (a) All optimal binary net- 
works with 4 nodes and 3 links. Each network is labeled according to its geometric degeneracy, gd- (b) 
Experimentally measured {9{t)) for sensitive (green, = 3) and nonsensitive (blue, gd = 1) configu- 
rations, where the coupling is enabled at t = 0. The individual curves represent measurements repeated 
for 100 different initial conditions for each network, (c) Numerical simulation of the same networks and 
conditions considered in (b). Inset: difference between the decay exponents of the networks considered 
in (b) when simulated in the absence of mismatches, noises, and time delays, as a function of 6{t), regarded 
as a tunable initial synchronization error. 

associated with the same (degenerate) eigenvector. In the star network, each eigenvalue is asso- 
ciated with a linearly independent eigenvector, and hence (7^ = 1. In the case of the linear chain, 
all three nonzero eigenvalues are associated with the same eigenvector, and hence gd = S. While 
we focus on optimal and suboptimal networks, where sensitive networks are expected to be more 
common because of their highly degenerate eigenvalue spectra, this classification also applies to 
nonoptimal networks in general. 

Compared to the nonsensitive case, the sensitive networks exhibit slower convergence to syn- 
chronization and, across different realizations, larger variations around the average synchroniza- 
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FIG. 4. Dependence of synchronization properties on experimental parameters. Setting observational noise 
r/ = 0.06, coupling mismatch ( = 0.01, and time delay r = 1.5ms (dashed lines), which approximate the 
values estimated in the experiment, we simulated the effect of varying one of these parameters at a time. 
Each data point is estimated from 1000 independent realizations for the networks considered in Fig.|3lb,c). 
(a) effect of rj on the ensemble mean synchronization floor, ^o; (b) effect of rj on the standard deviation of 
the floor, 6; (c) effect of C on 6; and (d) the effect of r on ^o- The superscript n (s) denotes the nonsensitive 
(sensitive) network. 



tion trajectory [Fig. [3tb)]. In particular, while the nonsensitive network has an exponential con- 
vergence to synchronization, the sensitive network has a non-exponential convergence, which is 
in agreement with the polynomial transient theoretically predicted for such networks tm ■ More- 
over, the bundle of trajectories 9(t) is broader by a factor of ten for the sensitive network over the 
nonsensitive network in the transient to synchronization. This difference, we hypothesize, is due 
to the different response exhibited by these different types of networks to experimental perturba- 
tions, since in the absence of mismatches, noises, and delays, the asymptotic rate of convergence 
is expected to be the same. The latter is confirmed in the inset of Fig. Oc), where we simulated 
Eqs. ([T]|2l) under these conditions, thus recovering the prediction previously established for the 
idealized Pecora-CarroU model M\- The essence of this phenomenon is that convergence to zero 
is the same for both types of networks, but to a finite synchronization floor it is not. 

To test our hypothesis, we have simulated Eqs. ([T]|2l) in the presence of observational noise 
and coupling mismatch. The coupling mismatch is taken to be independent perturbations to the 
nonzero off diagonal elements of iij in Eq. ^ drawn from a Gaussian distribution with zero mean 
and standard deviation (. The observational noise is modeled as the difference between the actual 
Xi{t) in the system, described by Eq. and the observed Xj(t), drawn from a Gaussian distribu- 
tion with zero mean and standard deviation t]. Based on the dominant factors in the experimental 



setup, we choose these values to he rj = 0.06 and ( = 0.01, which are estimates for the rounding 
error in the recording of the data and coupling mismatch due to realistic imperfections in the net- 
work construction. As shown in Fig.[3tc) (and, for larger networks, in supplementary information, 
Fig. S2), with this parameter choice our simulation of the system mimics the key features observed 
in the experiment to a remarkable degree. 

The parameter dependence is further investigated in Fig. IH where we simulate the dependence 
of the average synchronization floor and the variation around it for sensitive and nonsensitive con- 
figurations, as a function of the noise, r], mismatch, (, and the feedback delay time, r. The floor 
itself is mainly determined by the observational noise. The difference in the variations around 
the floor is mainly determined by the coupling mismatch. The time delay, on the other hand, is 
found to have very limited influence on these properties. As shown in supplementary information. 
Fig. S3, similar results hold for larger networks. Our simulations also show that oscillator mis- 
match and dynamical noise comparable to ( and 77 would lead to very large difference between the 
average synchronization floor of sensitive and nonsensitive networks; since this is not observed 
experimentally we posit that these two factors are likely to be extremely small in the experiment. 
Incidentally, this also illustrates the distinct nature of the problem considered in this study com- 
pared to eigenvector-dependent synchronization in externally forced systems [12] and in systems 



with oscillator mismatches [113 



14ll . On the other hand, while we classify our networks according 



to degeneracy of the eigenvectors, we note that nonsensitive networks can exhibit different levels 
of nonnormality, ranging from the extreme in which all eigenvectors are orthogonal to the case 
in which two or more of them are nearly parallel. Among the nonsensitive networks, it is thus 
expected that robustness to perturbation will be further strengthened if they are closer to normal, 
which is a phenomenon previously identified in fluid and drive-response systems [|l5L ll6ll. 

The experimental results presented here verify that in a network of diffusively-coupled oscil- 
lators the rate of convergence to synchronization depends non-monotonically on the number of 
links. We also predict and experimentally demonstrate that, depending on the eigenvector prop- 
erties of the coupling matrix, co-spectral networks can exhibit quantitatively and qualitatively 
different convergence to synchrony. This study introduces the concept of sensitive and nonsensi- 
tive networks, providing objective criteria for determining the robustness of real networks based 
on their eigenvector degeneracies. 

We thank C. Williams for designing the amplifier circuit boards. This work was supported by 
DOD MURI Grant No. ONR N000140710734 and NSF Grant No. DMS-0709212. 
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TABLE SI. Optimal (shaded rows) and suboptimal (white rows) binary networks with = 4 nodes 
classified according to the number of connections m (rows) and geometric degeneracy (columns). The 
highlighted column (leftmost) shows a path (used in the experiment of Fig. 2(c)) from an optimal tree 
(m = 3) to a fully connected network (m = 12) which contains only nonsensitive configurations {g^ = 1). 
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FIG. S 1 . Non-monotonic behavior of synchronization properties for nonsensitive networks with = 50 
nodes, (a) Eigenvalue spread cr as a function of the number of links m. (b) Mean convergence rate to syn- 
chronization, fl, determined by simulating the system as modeled by Eqs. (l)-(2) (main text), (c) Conver- 
gence rate estimated as a weighted average over the various eigenmodes using the experimentally measured 
master stability function M{eX/d) (inset), which was obtained from a series of experimental measurements 
on a two node network. The domain of M shown corresponds to the region where synchronization is ob- 
served experimentally. The coupling strength e used in (b, c) is chosen so that eA/d for the optimal networks 
of size 50 is the same as the experimental value used for the optimal networks of size 4. This is marked 
with the subscript exp in the inset of panel (c). 
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FIG. S2. Transition to synchronization for sensitive and nonsensitive networks with = 50 nodes, (a, 

b) Configurations with m = N — 1 links and ga = ^ and 5, respectively, (c) Numerical simulation of the 

synchronization error, {9{t)), for the networks shown in (a) {gd = 1, blue) and (b) {g^ = 5, green), (d-f) 

Same as in (a-c) for configurations with m = 2N — 2 links, and gd = I (blue) and 15 (green). 
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FIG. S3. Simulation results for networks with = 50 nodes, (a-d) Counterpart of Fig. 4 for the networks 
considered in Fig. S2(a-c). (e-h) Corresponding results for the networks considered in Fig. S2(d-f). 
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